
AIAA 93-3439 

Application of a Two Camera Video 
Imaging System to Three-Dimensional 
Vortex Tracking in the 80- by 120-Foot 
Wind Tunnel 

Larry A. Meyn 

NASA Ames Research Center, Moffett Field, CA 
Mark S. Bennett 

Sterling Federal Systems, Inc., Palo Alto, CA 


AIAA Applied Aerodynamics 
Conference 

August 9-1 1 , 1993 / Monterey, CA 


For permission to copy or republish, contact the American Institute of Aeronautics and Astronautics 
370 L'Enfant Promenade, S.W., Washington, D.C. 20024 



APPLICATION OF A TWO CAMERA VIDEO IMAGING SYSTEM TO 
THREE-DIMENSIONAL VORTEX TRACKING 
IN THE 80- BY 120-FOOT WIND TUNNEL 

Larry A. Meyn* 

NASA Ames Research Center , Moffett Field, California 94035-1000 
Mark S, Bennett 1- 

Sterling Federal Systems, Inc., Moffett Field, California 94035 


Abstract 

A description is presented of two enhancements for a 
two-camera, video imaging system that increase the 
accuracy and efficiency of the system when applied to the 
determination of three-dimensional locations of points 
along a continuous line. These enhancements increase the 
utility of the system when extracting quantitative data 
from surface and off-body flow visualizations. The first 
enhancement utilizes epipolar geometry to resolve the 
stereo “correspondence” problem. This is the problem of 
determining, unambiguously, corresponding points in the 
stereo images of objects that do not have visible reference 
points. The second enhancement, is a method to 
automatically identify and trace the core of a vortex in a 
digital image. This is accomplished by means of an 
adaptive template matching algorithm. The system was 
used to determine the trajectory of a vortex generated by 
the Leading-Edge extension (LEX) of a full-scale F/A-18 
aircraft tested in the NASA Ames 80- by 120-Foot Wind 
Tunnel. The system accuracy for resolving the vortex 
trajectories is estimated to be ± 2 inches over distance of 
60 feet. Stereo images of some of the vortex trajectories 
are presented. The system was also used to determine the 
point where the LEX vortex “bursts”. The vortex burst 
point locations are compared with those measured in 
small-scale tests and in flight and found to be in good 
agreement. 

Nomenclature 

b - distance between cameras 

c - aerodynamic chord length 

/ - focal length of a camera lens 

h - height dimension 

O - center of projection for a camera lens 

R,L - 3-D transformation matrices 

rij, l(j - matrix coefficients 

s - length dimension 

x,y,i - orthogonal position coordinates 

6 - angle dimension 

subscripts 

if - matrix coefficient indices 


* Aerospace Engineer. Member AIAA. 
t Professional Staff 

Copyright © 1993 by the American Institute of Aeronautics and 
Astronautics, Inc. No copyright is asserted in the United States under 
Title 17, U.S. Code. The U.S. Government has a royalty-free license to 
exercise all rights under the copyright claimed herein for Governmental 
purposes. All other rights are reserved by the copyright owner. 


/ - left camera coordinate system 

r - right camera coordinate system 

w - world camera coordinate system 

superscripts 

' - denotes image plane coordinates 

Introduction 

A low-cost, video imaging system for three- 
dimensional, stereo ranging has been developed for use in 
large-scale wind tunnel tests. 1 ’ 2 Potential applications 
include vortex tracking, tracing of surface and off-body 
streamlines, and measurement of model positions and 
deflections. This paper first describes the development 
two enhancements that increase the accuracy and efficiency 
of the system when applied to the determination of three- 
dimensional locations of points along a continuous line. 
Some results are then presented of three-dimensional 
vortex trajectory measurements obtained during tests of a 
full-scale F/A-18 aircraft in the 80- by 120-Foot Wind 
Tunnel.-* 

The first enhancement to the stereo ranging system 
was a method of resolving the stereo “correspondence” 
problem for objects like flow field streamlines that are 
made visible by common flow visualization techniques. 
The stereo ranging system determines the three- 
dimensional location of point from the two-dimensional 
coordinates of the image of that point on each camera’s 
image plane. The “correspondence” problem in stereo 
ranging, is to identify points in each image that 
correspond a single point on the object being measured. 
The initial application of the system, which was to 
measure the angle-of-attack of parafoils tested in the 80- 
by 120-Foot Wind Tunnel 4 , used visual markers sewn on 
to the parafoils to identify corresponding point locations 
in the two stereo images. However, when tracking the 
path of a smoke-enhanced vortex or streamline, no such 
marking system is readily available. Although a laser 
light sheet could be used to mark locations on the vortex, 
the number of points would be limited and the overall 
complexity of the system would be increased. Instead, the 
method chosen to resolve the stereo correspondence 
problem for vortices and streamlines utilizes geometric 
constraints that are imposed by epipolar geometry 
inherent in stereo systems. 

The second enhancement, is a method to 
automatically identify and trace the core of a vortex in a 
digitized image. To method uses template matching to 
identify and locate cross-sections of the vortex image. 
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Template matches are made using digital cross-correlation. 
A single template cannot be used, since the vortex 
broadens as it moves downstream and the template must 
broaden accordingly. Therefore, the method developed 
utilizes an adaptive template. 



Figure 1 Schematic of the Stereo Ranging System 
Configuration for the F/A-18. 


These enhancements to the stereo ranging system 
first used to track vortices generated by the leading edge 
extension (LEX) of an full-scale F/A-18 at various angles 
of attack. Two video cameras were arranged as shown in 
Figure 1. One is mounted in the ceiling upstream of the 
F/A-18 aircraft and the other is mounted in the ceiling 
downstream of the aircraft. Smoke is injected into the 
flow near the apex of the LEX to make the LEX vortex 
visible. The LEX vortex is also often visible when 
humidity and temperature conditions are such that water 
vapor condenses within the vortex. Images from each 
camera, such as those shown in Figure 2, are captured and 
displayed on computer monitors. The images are then 
processed to determine the two-dimensional track of the 
vortex in each image. The two vortex tracks are then used 
to reconstruct the three-dimensional trajectory of the 
vortex. 



Figure 2 View of the F/A-18 from the left camera. 


Theory 

Stereo Ranging 

Stereo range finding is a three-dimensional procedure 
that locates a point in space by triangulation. Figure 3 
shows a simple, two-dimensional representation of the 
geometric relationships involved. The camera images are 
modeled as “line-of-sight” projections of scenes onto 
image planes (i.e. video screens). The image planes are 
placed at a distance, f r and // in front of their respective 
focal points, O r and 0/. Each camera has a coordinate 
system centered on it’s focal point and is oriented with the 
z-axis perpendicular to the image plane. 


LEFT IMAGE A RIGHT IMAGE 



In this figure, the goal is to locate Point A using its 
images projected onto the left and right image planes. 
Point A is at location ( x w , y Wf z w ) in the spatial or world 

coordinate system. Point A projects onto the left and 
right image planes at locations {x r \,fi) and (x' r , f r ) in the 

left and right camera coordinate systems, respectively. If 
the position and orientation of each camera is known, 
then the angles 0/ and 0 r can be determined from x’i and 
x’ r . Knowledge of the two angles (0/ and B r ) and the 
distance between the two focal points b , makes it possible 
to determine the position of Point A by use of 
trigonometric relationships. 

While trigonometric relationships are useful in 
understanding how a stereo ranging system works, they 
are impractical to implement for generalized three- 
dimensional system configurations because the camera 
locations, camera geometries, and camera orientations 
cannot be determined accurately enough for the desired 
resolution. Instead, a generalized matrix model is used, 
where each point in space is represented by a location 
vector for a particular coordinate system. Thus, to 
calibrate a camera, a location vector is converted from the 
external "world" coordinate system to the camera 
coordinate system by multiplying it by a transformation 
matrix. The relationship is expressed below for the right 
camera member of the stereo pair. 
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h\ x w + hi y* + r \3 z w + r U = x r 

hn x w + r 2iy w + r 23 z w + r 2 i = )V W 

r 3\ x w + r 32>'w + r 33 z w + r 3i = z r 


The coefficients, are the calibration coefficients 
for the right camera; the vector, (x w , y Wi z w \ represents a 


point in the external "world” coordinate system; and the 
vector, ( x r , y r> z r ), represents the same point in the right 

camera coordinate system. A similar equation set is used 
for the left camera. 

The camera image is a projection of a three- 
dimensional image onto a two-dimensional image plane, 
i.e., a video screen. Only the intersection of the three- 
dimensional image vector, ( x r , y r> z r ), with the image 

plane is known. Since all points on the image plane have 
az-value equal to the focal Iength,/ r , the vector (*>, y>) 

is used to describe points on the image plane. By use of 
similar triangles, the variables x' r andyV are related to 

the three-dimensional camera coordinates by the following 
equations. 


X r 


fr z r 

fr Z r 


(2a) 

(2b) 


If a point in the right image, ( x' r , y' r ), and the 
corresponding point in the left image, ( x'i , y’f) are known, 
the world coordinate vector, (x w , y Wf z w ), can be recovered 
using the following relationship. 


(*>31 “ r n) x w + (*> 32 " r n)y* + (*>33 " = r u - x' r (3a) 

(>> 31 ~ r 2\) x w + (>>32 ~ r 22 )y w + (>>33 = r 24 “>f ( 3b ) 

(xfe i -ln) x w + { x ih2 ~ hi )> w + (*/*33 “ hi) z w = ^i4 - x \ ( 3c ) 

{y'lh i “ hi) x w + (ylhi ~ hi )>w + (>>33 ~ hi) z w = h* “ >/ ( 3d ) 


Point Correspondence 

Equation set (3) assumes that the corresponding 
screen location of the point in object space is known in 
each camera view. When finding the angle of attack of 
parafoils 1 ’ 4 , markers were sewn on the parafoils to make 
the determination. However, in the case of vortex 
tracking, a smoke filled vortex essentially presents a 
continuous line in both images, which makes it difficult 
to visually identify corresponding points. This is where 
epipolar geometry is used. 

Figure 4 illustrates the basic elements of epipolar 
geometry. An epipolar plane is defined by a point on the 
vortex path and the two camera focal points. The 
intersection of an epipolar plane with the image planes is 
a pair of epipolar lines, along which the image of the 
point on the vortex must lie. The same epipolar plane can 


also be defined by a point on the left camera image and 
the two camera focal points. By choosing a point on the 
vortex track in the one image, an epipolar line can be 
computed for the other image. The intersection of the 
epipolar line with the vortex track in the second image 
provides the location of the point corresponding to the 
point chosen in the first image. 



LEFT IMAGE PLANE RIGHT IMAGE PLANE 

Figure 4 Epipolar Geometry. 


The equation for epipolar lines is derived as follows. 
Equation set (3) is rearranged to form the following 
homogeneous matrix equation. 


(Vii-'ii) (Vfe-'te) (-V 33 - r n) (K~ r u) 

'*w 


" 0 " 

U'Si-'Si) (tf'te-'fc) Ofos-'fc) W-'m) 

y w 


0 

( x ’ihi~h\) ( x iha “(2) ~ (3) [ x i ~ (4) 



0 

(yihi-hi) {y’lhi ~ (n) (>/ _ ^»)_ 

1 


0 


Equation (4) has a solution when the determinant of 
the 4x4 matrix is zero. Following the method described 
by Schalkoff 4 , the determinant can be expanded, set equal 
to zero, and reorganized to produce the following bilinear 
equation: 


mjjc'x/ + m2x' r y'i + m 3 y' r x'i + 
m A y' r yl + m 5 x' r + m^x'i + (5) 

m 7 y' + m^yl + mg= 0 

In equation (5), the coefficients, «/, consist of 
combinations of the coefficients of the two transformation 
matrices. As an example of how equation (5) is used, 
assume a point on the vortex is chosen in the left image. 
When the coordinates for this point are entered into 
equation (5), the resultant equation describes an epipolar 
line in the right image. The intersection of the epipolar 
line with the vortex track in the right image is the point 
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corresponding the chosen point in the left image. The 
coordinates of the two image points are then used in 
equation set (3) to determine the three-dimensional 
location of the actual point on the vortex. 

Vortex Image Enhancement 

When a pair of stereo images for vortex tracking are 
recorded, the first step is to determine the coordinates for 
the vortex track in each image. To simplify the process, 
a region of interest surrounding the vortex in each image 
is selected, such as is shown in Figure 5. From these 
regions, reference images of the aircraft without a visible 
vortex are subtracted. This helps isolate the vortex, but a 
few aircraft features still remain due to differences in 
lighting and model deflections when the reference images 
were recorded. Following image subtraction, a vortex can 
often be isolated by applying a threshold to the image. 
This is accomplished by making all pixels with a 
brightness value above a certain level white and all the 
remaining pixels are made black. Unfortunately, with 
the F/A-18 LEX vortex images, it was not possible to 
isolate the image of the LEX vortex from the image of 
the white paint along the LEX edge using the 
thresholding method. To isolate the vortex in this 
situation requires a more sophisticated technique. 



Figure 5(a) The vortex in the left camera image. 



Figure 5(b) The vortex in the right camera image. 


In order to determine which pixels belong to the core 
of the vortex, the assumption is made that the densest 
smoke digitizes and corresponds to the brightest pixels. 
Figure 6 shows pixel values versus pixel location for a 
cross-sectional "slice" through the vortex in the image. 
This can be thought of as the local vortex "signature" and 
the peak is assumed to be the core or center of the vortex. 
To track the vortex, the selected region of interest is 
divided into columns (or rows). The location of the 
vortex core in each column is determined from a cross- 
correlation of the pixel value distribution in the column 
with a template of the vortex signature. This method is 
very robust, and it easily picks out the vortex core even 
when the pixel value distribution contains some aircraft 
remnants, such as white paint on the LEX as shown in 
Figure 7. 



However, a single vortex template cannot be used for 
the entire length of the vortex, because, as the point in 
question moves downstream from the vortex origin, the 
smoke diffuses and the vortex signature broadens. 
Recognizing that this is a gradual change, a convenient 
means by which a local template may be provided is to 
use the pixel distribution of the previous column. Once a 
template match is found and the peak location determined, 
the template is replaced by the current cross-section and 
this new template is used on the next column. Thus, as 
the vortex signature changes shape, the template adapts. 
For the very first iteration, however, the user has to 
provide initial templates for the left and right images. 
This is done by identifying a representative line of pixels 
across the vortex near the origin. The starting templates 
can be saved, and a single pair of starting templates can be 
used for several similar images. 
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Figure 7 A vortex signature template and an image cross- 
section containing the vortex and the LEX edge. 


The correlation method comes from reference 6. The 
row (or column) of pixels containing image data is 
represented by the discrete function, g ^ and the template 
pixels by the discrete function, /z*. The correlation 
function, Corr (g,h)j, is found by taking the Fourier 
transforms of g^ and h £, and multiplying one by the 

complex conjugate of the other as is shown in the 
following equation. 

Con(g,h)j=G k H k * (6) 

In equation (6) G* and are the discrete Fourier 
transforms of g ^ and hjc and the subscript, j, denotes the 

lag between the two functions. If the maximum of the 
cross-correlation occurs at j = 0, then the functions 
coincide. If the maximum occurs at a lag other than zero, 
then the lag indicates the distance in pixels between the 
peak in the template and the peak in the image data. In 
this way the position of the vortex core can be easily 
identified. Figure 8 shows the results of the correlation 
matching algorithm on a typical vortex image, wherein 
the algorithm was able to ignore the remnant image of the 
LEX edge which intersects the vortex trail. 



Figure 8 The vortex track determined by the template 
matching algorithm overlaid on the source image of the 
vortex and LEX edge. 

To represent the vortex as a continuous function, a 
least squares curve fit is made to the pixels identified as 
lying along the image of vortex core. After a continuous 
function has been determined for both the left and right 
vortex images, then one image is chosen as the reference 
image from which the epipolar lines are determined for the 
other image. The intersection of the epipolar lines with 
the function describing the image of the vortex core yields 
a list of corresponding points from which the three- 
dimensional vortex track is determined. 

Results 

In order to obtain the flow visualization images of the 
F/A-18 vortex trail, the wind tunnel was operated at a 
speed of 92 ft/sec (10 psf dynamic pressure). At angles- 
of-attack tested, the F/A-18 LEX generates a very strong 
vortex. At some distance downstream of the origin, the 
vortex undergoes what is referred to as "vortex burst”. 

The point where the smoke-enhanced suddenly expands is 
the location of the vortex burst. This point is not steady, 
even when the aircraft maintains a fixed angle-of-attack. 
Instead, the burst point tends to moves fore and aft over a 
short range. As the aircraft increases angle-of-attack from 
18 to 50 degrees, the burst point moves forward. Figure 
9 shows a side view of the LEX vortex path up to the 
burst point for angles-of-attack of 25°, 30°, 35°, and 40°. 
The length of the vortex is shown to decrease with angle- 
of-attack. The three-dimensional trajectories for these 
same angles-of-attack are presented as a stereo image pair 
in Figure 10. The burst point as a function of angle-of- 
attack for the full-scale F/A-18 test is shown in Fig 1 1 
along with burst point data from flight tests^, 1 1%-scale 
wind-tunnel test s^, 6%-scale wind-tunnel tests 9 and a 2-% 
scale water-tunnel test^. As can be seen, the vortex 
burst locations for all of these tests are in good 
agreement. 



Figure 9 Vortex trajectories for several angles-of-attack 
superimposed on a wire-frame model of the aircraft. 
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Figure 10 A stereo pair showing vortex trajectories at four angles-of-attack superimposed on a wire-frame model of the 
aircraft. The view is from the above, right, rear position. 



Figure 1 1 F/A-18 vortex burst location as a function of 
angle-of-attack for several model scales. 

Conclusion 


This paper described two enhancements to a two- 
camera video imaging system that improved the accuracy 
and efficiency the system when used to track the three- 
dimensional vortices generated by the LEX of a full-scale 
F/A-18 aircraft. Two steps were involved in the process. 
The first enhancement was to use epipolar geometry to 
identify corresponding points along the vortex in both 
camera images. The second enhancement was the 
development and implementation of a fast and robust 
algorithm to locate a vortex core in digital image that 
contains misleading image fragments. 

Using stereo image data from a full-scale F/A-18 
wind tunnel test, the three-dimensional vortex trajectories 
computed by the system are estimated to be within ±2 
inches over a range of 60 feet. Burst point locations 
determined by the system were shown to agree very well 
with burst point locations determined in small-scale tests 
and in flight. 
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